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Abstract 

Starting with a likelihood or preference order on worlds, we extend it to a Hkelihood 
ordering on sets of worlds in a natural way, and examine the resulting logic. Lewis earlier 
considered such a notion of relative likelihood in the context of studying counterfactuals, 
but he assumed a total preference order on worlds. Complications arise when examining 
partial orders that are not present for total orders. There are subtleties involving the exact 
approach to lifting the order on worlds to an order on sets of worlds. In addition, the 
axiomatization of the logic of relative Hkelihood in the case of partial orders gives insight 
into the connection between relative likeHhood and default reasoning. 

1. Introduction 

A preference order ^ on a set W of worlds is a reflexive, transitive relation on W. Various 
readings have been given to the y relation in the literature; u y v has been interpreted as "m 
at least as preferred or desirable as (Kraus, Lehmann, & Magidor, 1990; Doyle, Shoham, 
& Wellman, 1991) (it is this reading that leads to the term "preferential structure"), "« at 
least as normal (or typical) as f" (Boutilier, 1994), and "m is no more remote from actuality 
than (Lewis, 1973). In this paper, we focus on one other interpretation, essentially also 
considered by Lewis (1973). We interpret u y v as meaning "« is at least as likely as 
Interestingly, all these readings seem to lead to much the same properties. 

In the literature, preference orders have been mainly used to give semantics to condi- 
tional logics (Lewis, 1973) and, more recently, to nonmonotonic logic (Kraus et al., 1990). 
The basic modal operator in these papers has been a conditional where p ^ q is inter- 
preted as "in the most preferred/normal/likely worlds satisfying q is the case". However, 
if we view y as representing likelihood, then it seems natural to define a binary operator 
^ on formulas such that ip ^ ip is interpreted as is more likely than . Lewis (1973) 
in fact did define such an operator, and showed how it related to However, he assumed 
that y was total; that is, he assumed that for all worlds w,w' G W, either w y w' or 
w' y w. But in many cases in preferential or likelihood reasoning, it seems more appro- 
priate to allow the preference order to be partial. It may well be that an agent finds two 



1. There is a tradition, starting with Lewis (1973), of taking u ^ v, rather than u y v, to mean that u 
is as preferred or as desirable as v. This last reading historically comes from the interpretation of the 
preferred world as being less far from actuality. Since there seems to be a split in the reading in the 
literature, and y has traditionally been taken to mean "at least as likely" in the literature on qualitative 
probability (Fine, 1973; Gardenfors, 1975), we take this reading here. 
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situations incomparable as far as normality or likelihood goes. For example, one situation 
may be better in one dimension but worse in another. 

As we show in this paper, there are some subtleties involved in starting with a partial 
preference order on worlds. What we are ultimately interested is not an ordering on worlds, 
but an ordering on sets of worlds. To make sense of a statement like ip ^ ip, we need to 
compare the relative likelihood of the set of worlds satisfying ip to that of the set satisfying 
ip. Unfortunately, there are many possible ways of extending a preference order on worlds 
to one on sets of worlds. We focus here on two particular choices, which both agree with the 
definition given by Lewis in the case that the preference order on worlds is total, but differ 
in general. We define ^ using the definition that allows us to make the most interesting to 
work in default reasoning. 

We then turn our attention to axiomatizing the likelihood operator. Lewis provided an 
axiomatization for the case where the preference order is partial. The key axioms used by 
Lewis were transitivity: 

and the union property: 

This latter property is characteristic of possibility logic (Dubois & Prade, 1990). In the 
partially ordered case, these axioms do not suffice. We need the following axiom: 

V (^2) » m) A (((pi V (^3) » (^2) ^ (<pi » (<P2 V (^3)). 

It is not hard to show that this axiom implies transitivity and the union property (in the 
presence of the other axioms), but it is not equivalent to them. Interestingly, it is the 
property captured by this axiom that was isolated in (Friedman &; Halpern, 1997) as being 
the key feature needed for a likelihood ordering on sets to be appropriate for doing default 
reasoning in the spirit of (Kraus et al., 1990). Thus, by considering preference orders that 
are partial, we are able to clarify the connections between and default reasoning. 

The rest of this paper is organized as follows. In Section 2, we consider how to go from 
an ordering on worlds to one on sets of worlds, focusing on the differences between total 
and partial preference orders. In Section 3, we present a logic for reasoning about relative 
likelihood and provide a natural complete axiomatization for it. In Section 4, we relate 
our results to other work on relative likelihood, as well as to work on conditional logic and 
nonmonotonic reasoning. We conclude in Section 5. Proofs of the technical results can be 
found in Appendix A. 

2. From Preorders on Worlds to Preorders on Sets of Worlds 

We capture the likelihood ordering on a set W of possible worlds by a partial preorder — that 
is, a reflexive and transitive relation — y on W ? We typically write w' y w rather than 

2. A partial order R is typically assumed to be reflexive, transitive, and anti- symmetric (so that if (a, b) ^ R 
and (b,a) € R, then a = b). We are not assuming that >2 is anti-symmetric here, which is why it is a 

preorder. 
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{w', w) G y. As usual, we often write ii ^ v rather than v y u, and take u y v to he an 
abbreviation for u y v and not(i! y u), and ?/ -< ?; to be an abbreviation for v y u. The 
relation >- is a strict partial order, that is, it is an irrefiexive (for all w, it is not the case that 
w y w) and transitive relation on W. We say that y is the strict partial order determined 

by y. 

As we said in the introduction, we think of y as providing a likelihood, or preferential, or- 
der on the worlds in W. Thus, w y w' holds ifw is at least as likely /preferred/normal/close 
to actuality as w'. Given this interpretation, the fact that y is assumed to be a partial 
preorder is easy to justify. For example, transitivity just says that if u is at least as likely 
as V, and v is at least as likely as w, then u at least as likely as w. Notice that since y 
is a partial preorder, there may be some pairs of worlds w and w' that are incomparable 
according to y. Intuitively, we may not be prepared to say that either one is likelier than 
the other. We say that ^ is a total preorder (or connected, or a linear preorder) if for all 
worlds w and w' , either w y w' or w' y w. 

Since we have added likelihood to the worlds, it seems reasonable to also add likelihood 
to the language, to allow us to say 'V is more likely than for example. But what 
exactly should this mean? Although having y in our semantic model allows us to say that 
one world is more likely than another, it does not immediately tell us how to say that a set 
of worlds is more likely than another set. But, as we observed in the introduction, this is 
just what we need to make sense of "y? is more likely than 

How should we extend a likelihood ordering on worlds to one on sets of worlds? Clearly 
we want to do so in a way that preserves the ordering on worlds. That is, using [> to 
denote the ordering sets, we would certainly expect that u y v would imply {u} \> {v}. We 
could impose a few other minimal requirements, but they certainly would not be enough to 
uniquely determine an ordering on sets. For example, here are two general approaches; to 
distinguish them, we put subscripts on >. 

1. Define >i so that U \>i V if for all « G f7 and all v & V, we have u y v. We can 
define a strict partial order in this spirit in two distinct ways. 

(a) By considering the analogous procedure to that used to get y from y-. We define 
>2 so that U t>2V iiU t>iV and not{V t>i U). We call this the standard method 
below. 

(b) By replacing y in the definition of l>i by >-: We define >3 so that U l>3 V if 
for all u ^ U and all v ^ V, we have u y v. We call this the alternative method. 

2. Define l>4 so that U l>4 V if for all v & V — U, there is some u E U — V such that 
u y V. Note that this approach focuses on the symmetric difference between U and 
V. There are again two ways of getting a strict partial order. 

(a) The standard method gives us ?7 l>5 F if ?7 l>4 F and not(F l>4 U). 

(b) The alternative method gives us U \>q V if for all v E V — U there is some 
u & U — V such that u y v. 

The first approach ( |>i) was used by Doyle, Shoham, and Wellman (1991) in defining 
a logic of relative desire, starting with a preference order on worlds. Unfortunately, as 
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they themselves point out, these relations are too weak to allow us to make important 
distinctions. They go on to define other notions of comparison, but these are more tuned 
to their applications, and not in the spirit of the notions we are considering here. 

The second approach (typically >4 and >5) has been widely used in various applications 
in the literature. For example, 

• Dershowitz and Manna (1979) use it to define on ordering on multisets, which is then 
used to provide a technique for proving program termination. 

• Przymusinski (1987) uses it to order models of a database. 

• Brass (1991), Cayrol, Royer, and Saurel (1992), Delgrande (1994), and Geffner (1992) 
all use it to help model various aspects of default reasoning. 

In this paper, we focus on a variant of the second approach, essentially due to Lewis 
(1973), which has interesting connections to default reasoning. Roughly speaking, we take 
U to be more likely than V if for every world in V, there is a more likely world in U. 

To make this precise, ifU,V C we write U y'^ V if for every world v ^ V, there is a 
world u & U such that u y v. It is easy to check that is a partial preorder, that is, it is 
reflexive and transitive. (The superscript s is for "set".) Moreover, if ^ is a total preorder, 
then so is y^. Finally, as we would expect, we have u y v iff {«} y^ {v}, so the y^ relation 
on sets of worlds can be viewed as a generalization of the y relation on worlds. 

We can then apply both the standard method and the alternative method to define a 
strict partial order. The standard method gives us the relation y', where U y' V holds 
if U V and not(y U). The alternative method gives us the relation defined on 
finite sets by taking U y^ V to hold if U is nonempty, and for every world v G V, there is 
a world u ^ U such that u y v. (The reasons that U is taken to be nonempty and that the 
definition is restricted to finite sets are discussed below.) 

How do these various approaches compare? Clearly U [>iV implies U V, although 
the converse does not hold in general; l>i is a very weak ordering. As a consequence, l>2 
and are incomparable, as are >3 and Similar remarks apply to >4. Again, it is easy 
to see that U \>iV implies U y^ V. On the other hand, the two notions are not equivalent. 
For example, suppose v y v' . Then {v} y^ {?;,?/}, but we do not have {v} l>4 {v,v'}. 

Why are we focusing on y' , and here, rather than >i->6 (or some other no- 
tion)? From a likelihood viewpoint, they all seem to be reasonable; our intuitions regarding 
extending likelihood from worlds to sets of worlds do not seem to be that well developed. It 
may be possible to motivate y^ as the finest relation extending y that has certain proper- 
ties, but that was not in fact our motivation here. Rather, our interest is motivated by the 
deep connections between >-' and and certain approaches to nonmonotonic reasoning. 
Having said that, many of the questions that we consider here could perfectly well be ex- 
plored using l>i-I>c- With that apology, we do not discuss >i->6 further in this paper, 
except for the odd remark. 

We have explained that there are two methods for getting a strict partial order on sets 
of worlds from a partial order on worlds. But are the standard method and the alternative 
method really so diflferent? It is easy to see that u y v iff {u} y^ {v} iff {u} y' {v}. (This 
is true for |>25 l>35 l>55 and l>6 as well.) Thus, and y' agree on singleton sets and 
extend the >- relation on worlds. Moreover, both and y' are strict partial orders on 
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finite sets. (The requirement that U must be nonempty in the definition oiU V is there 
to ensure that we do not have 0; strictly speaking, we should have also added it to 
the definitions of l>3 and [>6 to ensure that they were strict partial orders.) As shown in 
Lemma 2.9, y' and are in fact identical if the underlying preorder y on worlds is a total 
preorder. However, as the following example shows, y^ and y' are not identical in general. 

Example 2.1: Suppose W = {wi,W2}, and y is such that wi and W2 are incomparable. 
Then it is easy to see that {wi,W2} y' {wi}. However, it is not the case that {wi,W2} y^ 
{wi}, since there is no element of {'Wi,W2} that is strictly more likely than wi.^ I 

Notice that we were careful to define y as we did only on finite sets. The following 
example illustrates why: 

Example 2.2: Let VFqo = {'"^o, '"^i, '"^2 5 • • and suppose that y is such that 

Then it is easy to see that if we were to apply the definition of y^ to infinite sets, then we 
would have Woo y'^ Woo, and y^ would not be irreflexive.^ I 

The approach for extending the definition of y^ to infinite sets is essentially due to 
Lewis (1973) (who did it for the case of total preorders). The idea is to say that in order 
to have U y^ V, it is not enough that for every element v in V there is some element u in 
U that is more likely than v. This definition is what allows Woo >~ Woo in Example 2.2. 
Notice that in the finite case, it is easy to see that if U F, then for every element v in 
V, there must some u & U such that, not only do we have u y v, but u dominates V in 
that for no v' ^ V do we have v' y u. It is precisely this domination condition that does 
not hold in Example 2.2. This observation provides the motivation for the official definition 
of y^, which applies in both finite and infinite domains. 

Definition 2.3: Suppose ^ is a partial preorder on W, U^V C VF, and w G W. We say 

that «; dominates V if for no i' G V is it the case that i' y w. (Notice that if ^ is a total 
preorder, this is equivalent to saying that w y v fov all v ^ V .) We write U y'^ V ii U is 
nonempty and, for all v & V, there exists u & U such that u y v and u dominates V. I 

It is easy to see that this definition of agrees with our earlier definitions if U and V 
are finite. 

We now collect some properties of y^, y', and y^. To do this, we need a few definitions. 
We say that a relation > on 2^ (not necessarily a preorder) is qualitative if (Fi U V2) l> 
and (Vi U Vs) > V2 implies Vi > (V2 LiVs). We say that > satisfies the union property if 
Vi > V2 and Vi > V3 imphes Vi \> {V2 U F3). We say that t> is orderly if U t> V, U' 5 U, 
and V' C V implies U' t> V. We provide some intuition for these properties following 
Proposition 2.5, after showing how they help us characterize y^, y', and y^. 

3. We remark that similar results hold for Os and I>6- They are identical if the underlying order on worlds 
is a total preorder, and this example can also be used to show that they differ if the underlying order is 
partial. 

4. Similar problems arise for I>6 when dealing with infinite sets, and the solution for y" described in 
Definition 2.3 can be applied to >6 as well. 
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Lemma 2.4: // > is an orderly qualitative relation on 2 , then > is transitive and satisfies 
the union property. 

Proof: See Appendix A. I 

The converse to Lemma 2.4 does not hold. Indeed, an orderly strict partial order on 
2^ may satisfy the union property and still not be qualitative. For example, suppose 
W = {a, 6, c}, and we have {a,b} > {c}, {a, c} > {b}, {a,b,c} > {b}, {a, 6, c} > {c}, and 
{a, 6, c} > {6, c}. It can easily be checked that > is an orderly strict partial order that 
satisfies the union property, but is not qualitative. 

With these definitions in hand, we can state the key properties of the relations we are 
interested in here. 

Proposition 2.5: 

(a) If y is a partial preorder on W , then is an orderly partial preorder on 2^ that 
satisfies the union property. 

(b) If h is a partial preorder on W, then >-' is an orderly strict partial order on 2^. 

(c) If >- is a strict partial order on W, then is an orderly qualitative strict partial 
order on 2^ . 

Proof: See Appendix A. I 

We can now discuss how to interpret the properties we have been considering in light of 
this result. 

To the extent that we think of > as meaning "more likely than", then orderliness is a 
natural property to require. If U is more likely than V, then certainly any superset of U 
should be more likely than any subset of V. It is thus not surprising that all three of the 
relations we have defined are orderly. 

Clearly the union property generalizes to arbitrary finite unions. That is, if > satisfies 
the union property and A > 5j, i = 1, . . . ,n, then A > 5i U . . . U 5„. In particular, if 
u y Vj for J = 1, . . . , N, then {?/} {I'l, . . . , i'a-}, no matter how large N is, and similarly 
if we replace y by y (since the fact that y^ is qualitative means that it satisfies the union 
property, by Lemma 2.4). This is very different from probability, where sufficiently many 
"small" probabilities eventually can dominate a "large" probability. This suggests that 
u y V should perhaps be interpreted as "m is much more likely than More generally, 
if > satisfies the union property, then U \> V can be interpreted as meaning that U is 
much more likely than V . In this sense, the notion of likelihood corresponding to or 
is closer to possibility (Dubois & Prade, 1990) than probability, since the relation "more 
possible than" satisfies the union property. 

Note that, in general, y' does not satisfy the union property. In Example 2.1, we have 
{wi,W2\ y' {wi} and {wi,W2} y' {W2}, but we do not have {wi,W2} y' {wi,W2}. 

The qualitative property is somewhat more difficult to explain intuitively. Of the three 
relations we are considering, only the relation satisfies it. The fact that y' does not 
satisfy it follows from Lemma 2.4, together with the observation that y' does not satisfy 
the union property. Example 2.1 also shows that y^ is not qualitative, since if it were. 
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we could conclude from {wi,tU2} W'2} (taking Vi = {wi} and V2 = V3 = {W2} in the 
definition of qualitative) that {u'l} {"'2}' a contradiction. Our interest in the c^ualitative 
property stems from the fact that, in a precise sense, it is the property that characterizes 
y^. It first arose in (Friedman Sz Halpern, 1997), where it was shown to be the key property 
required of a generalization of probability called plausibility to capture default reasoning. 
This is discussed in more detail in Section 4. 

If ^ is a total preorder, then we get further connections between these notions. Before 
we discuss the details, we need to define the analogue of total preorders in the strict case. 
A relation > on an arbitrary set W (not necessarily of the form 2^) is modular ifwi [>W2 
implies that, for all u'3, either ws \> W2 or wi \>ws. Modularity is the "footprint" of a total 
preorder on the strict order determined by it. This is made precise in the following lemma. 

Lemma 2.6: // ^ is a total preorder. then, the strict partial order y determined by y is 
modular. Moreover, if t> is a modular, strict partial order on W, then there is a total 
preorder y on W such that > is the strict partial order determined by y. 

Proof: See Appendix A. I 

Modularity is preserved when we lift the preorder from W to 2^. 

Lemma 2.7: If y is a modular relation on W, then y^ is a modular relation on 2^. 

Proof: See Appendix A. | 

Although we showed that the converse to Lemma 2.4 does not hold in general for strict 
partial orders, it does hold for orders that are modular. 

Lemma 2.8: If t> ts a modular strict partial order and satisfies the union property, then 
t> is qualitative. 

Proof: See Appendix A. I 

As shown in (Friedman & Halpern, 1997), there is a connection between nonmonotonic 
reasoning, conditional logic, and the qualitative property. (This is discussed in Section 4.) 
This relationship is best understood by considering y^, rather than y^ or y', which is why 
we focus on here. Lewis (1973) was able to use y' because he focused on total preorders. 
The following lemma makes this precise. 

Lemma 2.9: If y is a total preorder, then y^ and y' agree. In general, U y^ V implies 
U y' V, but the converse does not hold. 

Proof: See Appendix A. I 

We close this section by considering when a preorder on 2^ can be viewed as being 
generated by a preorder on W. This result turns out to play a key role in our completeness 
proof, and emphasizes the role of the qualitative property. 

Theorem 2.10: Let J- be a finite algebra of subsets of W (that is, T is a set of subsets of 
W that is closed under union and complementation and contains W itself) and let t> be an 
orderly qualitative relation on J- . 



7 



Halpern 



(a) If t> is a total preorder on T , then there is a total preorder y onW such that t> and 

agree on (that is, for U,V & J^, we have U t> V iffUy^V). 

(b) If t> is a strict partial order and each nonempty set in T has at least 2'°s(l-^l)'°*"'^" 
elements, then there is a partial preorder y on W such that > and agree on J-. 

Proof: An atom of ^ is a minimal nonempty element of J-. Since J- is finite, it is easy to 
see that every element of !F can be written as a union of atoms, and the atoms are disjoint. 
Part (a) is easy: for each w G W, let be the unique atom in T containing w. Define y 
on W so that v y w iS Ay t> A^- It is easy to see that if > is a total preorder on JF, then 
>: is a total preorder on W and > agrees with y^ on T. The proof of (b) is considerably 
more difficult; see Appendix A for details. I 

It is not clear that the requirement that the sets in have at least 2'°s(l-^l)'°^^''^'^ elements 
is necessary. However, it can be shown that Theorem 2.10(b) does not hold without some 
assumptions on the cardinality of elements in JF. For example, suppose that the atoms of 
T are A, B, and C. Let > be defined so that {B U C) t> A, W t> A, X t> ill for all nonempty 
X ^ J^, and these are the only pairs of sets that are in the > relation. It is easy to see 
that l> is an orderly, qualitative, strict partial order. However, if W = {a,b,c}, A = {a}, 
B = {b}, and C = {c}, there is no ordering y on W such that and [> agree on J^: it is 
easy to see that such an ordering >- must make a, b, and c incomparable. But if they are 
incomparable, we cannot have {b,c} y^ {a}. On the other hand, if we allow C to have two 
elements, by taking W = {a,b,c,d}, A = {a}, B = {6}, and C = {c,d}, then there is an 
ordering y such that y'^= [>: we simply take aye and b y d. 

3. A Logic of Relative Likelihood 

We now consider a logic for reasoning about relative likelihood. Let $ be a set of primitive 
propositions. A basic likelihood formula (over ^) is one of the form (p ^ xp, where (p and 
ip are propositional formulas over We read (/? ^ -0 as "(yj is more likely than ip^\ Let £ 
consist of Boolean combinations of basic likelihood formulas. Notice that we do not allow 
nesting of likelihood in £, nor do we allow purely propositional formulas. There would no 
difficulty extending the syntax and semantics to deal with them, but this would just obscure 
the issues of interest here. 

A preferential structure (over $) is a tuple M = (T'F, ^,7r), where W is a (possibly 
infinite) set of possible worlds, ^ is a partial preorder on VF, and vr associates with each 
world in a truth assignment to the primitive propositions in Notice that there may be 
two or more worlds with the same truth assignment. As we shall see, in general, we need to 
have this, although in the case of total preorders, we can assume without loss of generality 
that there is at most one world associated with each truth assignment. 

We can give semantics to formulas in C in preferential structures in a straightforward 
way. For a propositional formula ip, let {(pJm consist of the worlds in M whose truth 
assignment satisfies (p. We then define 

M 1= » ^ if Mm y' Mm. 

We extend |= to Boolean combinations of basic formulas in the obvious way. 
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Notice that M |= -^(^cp ^ false) iff l-ity^jM = iff 1^}m = W. Let Kcp be an abbrevia- 
tion for -'{-'(f ^ false). It follows that M |= K(p iff (p is true at all possible worlds.'^ 

With these definitions, we can provide a sound and complete axiomatization for this 
logic of relative likelihood. Let AX consist of the following axioms and inference rules. 

LI. All substitution instances of tautologies of propositional calculus 
L2. -n{(p » (p) 

L3. {{(pi V (p2) » (ps) A {{(pi V (pa) » (^2) ^ » (<P2 V (^3)) 

L4. {K{(p => Lp') A ^ ^) A > tp)) ^ ^' > ^' 
Gen. for all propositional tautologies ip (Generalization) 

MP. From ip and (p =^ ip infer ip (Modus ponens) 

L2, L3, and L4 just express the fact that is irreflexive, qualitative, and orderly, 
respectively; this is made precise in the proof of the following result. The axiom Gen is the 
analogue of the inference rule "From ip infer Kip" , typically known as generalization. We 
do not have this inference rule here, since our language does not allow nested occurrences 
of Thus, for an arbitrary formula ip, the formula Kip is not in our language. It is in our 
language only if tp is propositional; the axiom takes care of this case. 

Theorem 3.1: AX is a sound and complete axiomatization of the language C with respect 
to preferential structures. 

Proof: The validity of LI is immediate. It is clear that the fact that is irreflexive and 
qualitative, as shown in Proposition 2.5, implies that L2 and L3 are valid. To see that L4 
corresponds to orderliness, note that if M |= K(ip =^ ip') A K{7p' =^ ip) and ip S> ip, then 
{•■pIm C {(p'Im, li>']M C |-0]m, and {ipjM Mm- Since is orderly, it follows that 
WIm y' WIm, so M 1= > Ip'. Thus, L4 is valid. It is also clear that MP and Gen 
preserve validity. Thus, the axiomatization is sound. 

The completeness proof starts out, as is standard for completeness proofs in modal logic, 
with the observation that it suffices to show that a consistent formula is satisfiable. That 
is, we must show that every formula (p for which it is not the case that -^(p is provable 
from AX is satisfiable in some preferential structure M. However, the standard modal 
logic techniques of constructing a canonical model (see, for example, (Hughes & Cresswell, 
1968)) do not seem to work in this case. Finding an appropriate partial preorder on worlds 
is nontrivial. For this we use (part (b) of) Theorem 2.10. See Appendix A for the details. I 

What happens if we start with a total preorder? Let AX*^ consist of AX together with 
the obvious axiom expressing modularity: 

L5. {(fi > (P2) {{(fi > (fs) V {(fs > (P2)) 

We say that a preferential structure is totally preordered if it has the form {W,y,Tr), 
where >: is a total preorder on W. 

5. K was defined by Lewis (1973), although he wrote □ rather than K. 
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Theorem 3.2: AX^ ts a sound and complete axiomatization of the language C with respect 
to totally preordered preferential structures. 

Proof: For soundness, we just have to check that L5 is vaHd in totally ordered preferential 
structures. This is straightforward and left to the reader. The completeness proof uses 
Theorem 2.10 again, but is simpler than the proof of completeness in Theorem 3.1. We 
leave details to Appendix A. | 

We remark that in light of Proposition 2.8, we can replace L4 in AX^^ by axioms saying 
that ^ is transitive and satisfies the union property, namely: 

L6. (cpi » (^2) A {ip2 > ifa) =^ (ifi > ifa) 

L7. {{ipi » ip2) V {ipi » ips)) =^ {(pi » {(pi V ip2)) 

The result is an axiomatization that is very similar to that given by Lewis (1973). 

In the proof of Theorem 3.1, when showing that a consistent formula ip is satisfiable, the 
structure constructed may have more than one world with the same truth assignment. This 
is necessary, as the following example shows. (We remark that this observation is closely 
related to the cardinality requirements in Theorem 2.10(b).) 

Example 3.3: Suppose $ = {p,q}. Let (p be the formula {p » {^p A q)) A -■((p A q) ^ 
(-ipA(/)) A-i((pA-i(/) ^ (~'pAq)). It is easy to see that ip is satisfied in a structure consisting 
of four worlds, wi, W2,ws, w^, such that wi >- w^, W2 >- w^, pAq is true at wi, pA^q is true 
at W2, and -ip A g is true at both W3 and w^. However, 'p is not satisfiable in any structure 
where there is at most one world satisfying -17; A q. For suppose M were such a structure, 
and let w be the world in M satisfying -ip A q. Since M |= p » (-ip A (/), it must be the 
case that |p]m {'^}- Thus, there must be a world if' G |p]m such that w' y w. But w' 
must satisfy one of p A g or p A so M |= ((p A g) ^ (-ip A q)) V ((p A -^q) ^ (-ip A g)), 
contradicting the assumption that M \= ip. % 

It is not hard to see that the formula ip of Example 3.3 is not satisfiable in a totally 
preordered preferential structure. This is not an accident. 

Proposition 3.4: // a formula is satisfiable in a totally preordered preferential structure, 
then it is satisfiable in a totally preordered preferential structure with at most one world per 
truth assignment. 

Proof: See Appendix A. | 

The results of this and the previous section help emphasize the differences between 
totally preordered and partially preordered structures. 

4. Related Work 

The related literature basically divides into two groups (with connections between them): 
(a) other approaches to relative likelihood and (b) work on conditional and nonmonotonic 
logic. 
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We first consider relative likelihood. Gardenfors (1975) considered a logic of relative 
likelihood, but he took as primitive a total preorder on the sets in 2^, and focused on 
connections with probability. In particular, he added axioms to ensure that, given a preorder 

on 2^, there was a probability function Pr with the property that (in our notation) 
U V iE Pr(?7) > Pr(V'). Fine (1973) defines a qualitative notion :< of comparative 
probability, but like Gardenfors. assumes that the preorder on sets is primitive, and is 
largely concerned with connections to probability. 

Halpern and Rabin (1987) consider a logic of likelihood where absolute statements about 
likelihood can be made {ip is likely, ip is somewhat likely, and so on), but there is no notion 
of relative likelihood. 

Of course, there are many more quantitative notions of likelihood, such as probability, 
possibility (Dubois Sz Prade, 1990), ordinal conditional functions (OCFs) (Spohn, 1988), 
and Dempster-Shafer belief functions (Shafer, 1976). The ones closest to the relative likeli- 
hood considered here are possibility and OCFs. Recall that a possibility measure Poss on 
W associates with each world its possibility, a number in [0,1], such that for V C W, we 
have Poss(y) = sup{Poss('i;) : v G V}, with the requirement that Poss(VF) = 1. Clearly a 
possibility measure places a total preorder on sets, and satisfies the union property, since 
Poss(^ U B) = max(Poss(^), Poss(i?)). The same is true for OCFs; we refer the reader 
to (Spohn, 1988) for details. Fariiias del Cerro and Herzig (1991) define a logic QPL 
(Qualitative Possibilistic Logic) with a modal operator >, where > ^ is interpreted as 
Poss(|(p]) < Poss(|^]). Clearly, (p > ip essentially corresponds to ip ^ ip. They provide 
a complete axiomatization for their logic, and prove that it is equivalent to Lewis' logic. ^ 
Not surprisingly, an analogue of AX^ is also complete for the logic. Further discussion of 
the logic can be found in (Bendova & Hajek, 1993). We discuss other connections between 
possibility measures, OCFs, and our logic below, in the context of conditionals. 

We now turn our attention to conditional logic. Lewis's main goal in considering pref- 
erential structures was to capture a counterfactual conditional where ip ^ ^p is read 
as "if ijj were the case, then ip would be true" as in "if kangaroos had no tails, then they 
would topple over". He takes this to be true at a world w if, in all the worlds "closest" to 
w (where closeness is defined by a preorder y) where kangaroos don't have tails, it is the 
case that kangaroos topple over.^ 

More abstractly, in the case where W is finite, for a subset V C W, let best(F) = {v ^ 
V : v' y V implies v' ^ V}. Thus, best(y) consists of all worlds v ^ V such that no world 
v' & V is considered more likely than v. (We take best(0) = 0.) 

If W is finite, we define 

{M,w)^iP^p if best(MM) C IpIm. 

Thus, 7p ^ ip is true exactly if ip is true at the most likely (or closest) worlds where ip is 
true. 

6. Actually, the axiomatization given in (Fariiias del Cerro & Herzig, 1991) is not quite complete as stated; 
to get completeness, we must replace their axiom QPL4 — true > (p — by the axiom ip > false [Luis Farinas 
del Cerro, private communication, 1996]. 

7. To really deal appropriately with counterfactuals, we require not one preorder y, but a possibly different 
preorder for each world w, since the notion of closeness in general depends on the actual world. We 
ignore this issue here, since it is somewhat tangential to our concerns. 
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For infinite domains, this definition does not quite capture our intentions. For example, 
in Example 2.2. we have best(Tyoo) = 0- It follows that if M = (T^oo,^,7r), then M ^ 
true -ip even if vr makes p true at every world in Woa- We certainly would not want to 
say that "if true were the case, then p would be false" is true if p is true at all the worlds in 
VFoc! The solution here is again a generalization of Lewis's definition in the case of totally 
ordered worlds, and is much like that for in infinite domains. We say M |= (/'• ^ if 
for all u G A -^Jm, there exists a world ^; G |y? A such that v >- u and v dominates 
l-tip A ^]m- This definition agrees with the definition given above for the case of finite W. 

Lemma 4.1: IfW is finite, then bestd^Jjvf) ^ |(/?]m iff for all u G f-^ipATplM, there exists 
a world v € {if A iPIm such that v y u and v dominates A 'i^Im- 

Proof: See Appendix A. I 

Lewis (1973) argues that this definition of captures many of our intuitions for coun- 
terfactual reasoning. We can give another interpretation, perhaps more natural if we are 
thinking in terms of likelihood. We often want to say that (p is more likely than not — in £, 
this can be expressed as ip ^ -^(f. More generally, we might want to say that relative to tp, 
or conditional on being the case, (p is more likely than not. By this we mean that if we 
restrict to worlds where 7p is true, (p is more likely than not, that is, the worlds where (pAip 
is true are more likely than the worlds where ^ip Aip is true. 

Let us define ip ip to be an abbreviation for K-ttp W {ip A ip ^ -k^ A ip). That is, 
(;'• is true vacuously in a structure M if ?/; does not hold in any world in M; otherwise, 

it holds if (p is more likely than not in the worlds satisfying ip. 

Although the intuition for seems, on the surface, quite different from that for 
especially in finite domains, it is almost immediate from their formal definitions that they 
are equivalent. (This connection between and was already observed by Lewis (1973) 
in the case of total proeorders.) 

Lemma 4.2: For all structures M, we have M \= ip ^ ip iffM\=ip ip. 

Proof: This is almost immediate from the definitions. See Appendix A for details. | 

Given Lemma 4.2, we can write for both and The lemma also allows us to 
apply the known results for conditional logic to the logic of relative likelihood defined here. 
In particular, the results of (Friedman & Halpern, 1994) show that the validity problem for 
the logic of Section 3 is co-NP complete, no harder than that of propositional logic, for the 
case of both partial and total preorders.^ 

More recently, has been used to capture nonmonotonic default reasoning (Kraus et al., 
1990; Boutilier, 1994). In this case, a statement like Bird Fly is interpreted as "birds 
typically fly", or "by default, birds fly". The semantics does not change: Bird Fly is 
true if in the most likely worlds satisfying Bird, Fly holds as well. Dubois and Prade (1991) 
have shown that possibility can be used to give semantics to defaults as well, where -ip —> ip 

8. We remark that there are also well known axiomatizations for various conditional logics (Burgess, 1981; 
Friedman & Halpern, 1994; Lewis, 1973). These do not immediately give us a complete axiomatization 
for the logic of relative likelihood considered here, since we must find axioms in the language with 
not in the language with 
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is interpreted as Poss('i/') = or Poss((/:3 A tp) > Poss{ip A -^i>). Of course, this is just the 
analogue of the definition of in terms of Goldszmidt and Pearl (1992) have shown 
that a similar approach works if we use Spohn's OCFs. 

These results are clarified and unified in (Friedman &; Halpern, 1997). Suppose we start 
with some mapping PI of sets to a partially ordered space with minimal element _L (such 
a mapping is called a plausibility measure in (Friedman & Halpern, 1997)). Define ^ ^ ip 
as V\{ip) = _L or P1('0 A (/?) > A -■(/?). Then it is shown that satisfies the KLM 
properties — the properties isolated by Kraus, Lehmann, and Magidor (1990) as forming the 
core of default reasoning — if and only if PI is qualitative, at least when restricted to disjoint 
sets.^ Since Poss, and OCFs give rise to qualitative orders on 2^, it is no surprise that 
they should all lead to logics that satisfy the KLM properties. 

We remark we can also start with and then define ^ in terms of There are, in 
fact, three related ways of doing so. Define (p to be an abbreviation for ((i^V-^) {ipA 
-■!/;)) A-i(((/3Vi/;) i/;); define p S>" 'ip to be an abbreviation for -i((^ ip) A{{p\/'ilj) ~^'>p)', 
define ip ip to be an abbreviation for -'{ip false) A {{ip y ip) ^ {ip A -'i')). 

Proposition 4.3: For all structures M, the following are equivalent: 
(a) M ^ » ^ 
(h) M ^ ^ >' ^ 

(c) M^p »" ^. 

(d) M^ip ^. 

The first translation is essentially due to Kraus, Lehmann, and Magidor (1990), the sec- 
ond is essentially due to Freund (1993), and the third is due to Lewis (1973). Since the 
equivalences are so close to those already in the literature, we omit the proof of this result 
here. Using these equivalences and results of (Kraus et al., 1990), Daniel Lehmann [private 
correspondence, 1996] has provided an alternate proof for Theorem 3.1. See the remarks 
after the proof of that theorem in Appendix A for a few more details. 

5. Conclusion 

We have investigated a notion of relative likelihood starting with a preferential ordering on 
worlds. This notion was earlier studied by Lewis (1973) in the case where the preferential 
order is a total preorder; the focus of this paper is on the case where the preferential order is 
a partial preorder. Our results show that there are significant differences between the totally 
ordered and partially ordered case. By focusing on the partially ordered case, we bring out 
the key role of the cpalitative property (Axiom L3), whose connections to conditional logic 
were already observed in (Friedman k. Halpern, 1997). 



9. That is, if Vi, V2, and V3 are disjoint sets, we require that if Pl(ViUV2) > P1(V3) and Pl(ViUV3) > P1(V2), 
then ¥\{Vi) > ¥\{V2 U V3). The result also requires the assumption that if P1(C/) = Pl(l^) = -L, then 
P1(C/U V) = _L. 
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Appendix A. Proofs 

We repeat the statements of the results we are proving here for the convenience of the 
reader. 

Lemma 2.4: // > is an orderly qualitative relation on 2^ , then t> is transitive and 
satisfies the union property. 

Proof: Suppose [> is an orderly qualitative relation. To see that [> is transitive, suppose 
Vi > V2 and V2 > V3. Since > is orderly, it follows that (Fi U V3) > V2 and (Fi U V2) > V3. 
Since > is qualitative, it follows that Vi > {V2 U V3). From the fact that > is orderly, we 
get that Vi i> V3. Thus, l> is transitive, as desired. 

To see that > satisfies the union property, suppose Vi [> V2 and Vi > F3. Since |> is 
orderly, we have that (Vi U V3) > V2 and (Vi U V2) > V3. Using the fact that > is qualitative, 
we get that Vi > (V2 U V3). Hence, > satisfies the union property. I 

Proposition 2.5: 

(«') If ^ is a partial preorder on W , then is an orderly partial preorder on 2^ that 
satisfies the union property. 

(b) If is a partial preorder on W , then y' is an orderly strict partial order on 2^. 

(c) If >- is a strict partial order on W, then is an orderly qualitative strict partial 
order on 2^. 

Proof: We prove part (c) here; the proof of parts (a) and (b) is similar in spirit, and is 
left to the reader. The fact that is an orderly strict partial order is straightforward, 

and is also left to the reader. To see that y'^ is qualitative, suppose Vi U V2 y'^ T'3 and 
Vi U V3 V2. Let V G V2 U Vs. We must show that there is some v' G Vi that dominates 
V2 U F3 such that v' y v. Suppose without loss of generality that f G V2 (an identical 
argument works if v G V3). Since Vi U y^ V2, there is some « G U V3 that dominates 
V2 such that u y V. If u dominates V3, then it clearly dominates V2 U and it must be 
in Fi, so we are done. Thus, we can assume that ii does not dominate V3, so there is some 
element u' G F3 such that u' y u. Since Vi U V2 y^ F3, there must be some t;' G Vi U V2 
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such that v' dominates V3 and v' >- u' . Since u dominates V2 and u' >- u, it follows that u 
dominates V2. Since v' y u\ we have that v' dominates V2. Hence, v' dominates V2 U F3. 
It follows that v' cannot be in V2, so it must be in Vi. Thus, we have an element in Vi, 
namely v', such that v' y v and v' dominates V2 U V3, as desired. I 

Lemma 2.6: If h is a total preorder, then the strict partial order y determined by y 
is modular. Moreover, if t> is a modular, strict partial order on W , then there is a total 
preorder y on W such that > is the strict partial order determined by y. 

Proof: Suppose ^ is a total preorder. To see that >- is modular, suppose that wi y W2. 
Given an arbitrary w^, if y wi, it follows from the transitivity of y that y W2- On 
the other hand, if it is not the case that ws y wi, then wi y w^. Thus, we have that either 
y W2 or wi y wz, so y is modular. 

Now suppose that > is a modular strict partial order on W . Define y so that w y v 
either if w [> v or if neither w t> v nor v t> w hold. Clearly, y is reflexive. To see that it 
is transitive, suppose that vi y V2 and V2 h v^. There are three cases: (1) If t> V2, then 
since l> is modular, we have that either vi > or \> V2- We cannot have [> V2, for 
then we would not have ?'2 ^ ^^3. Thus, we must have vi t> v^, and hence I'l y v^. (2) If 
V2 > V3, then using modularity again, we get that either vi \> V3 or V2 \> vi. Again, we 
cannot have V2 \> vi, so we must have vi [> v^, and so we also have vi y v^. (3) If neither 
vi t>V2 nor V2 >i'3 hold, then we claim that neither vi t>V3 nor V3 t>vi hold. For iivi >i'3, 
then by modularity, we must have either vi > V2 or V2 \> V3. And if 1)3 l> I'l, then either 
vs t> t'2 or V2 t> vi, which contradicts the assumption that vi y V2 and V2 cl v^. Thus, we 
can again conclude that vi y V3. Thus, y is transitive. Finally, it is almost immediate from 
the definition that > is the strict partial order determined by ^. I 

Lemma 2.7: If y is a modular relation on W, then y^ is a modular relation on 2^. 

Proof: Suppose y is modular. We want to show that y^ is modular. So suppose that 
^1 V2, and it is not the case that Vi y^ V3. We must show that V3 y^ V2. Since it is not 
the case that Vi V3, there must be some v* G V3 such that for all ?/ G Vi. we do not have 
u y V*. Now suppose v G V2. We claim that v* y v. To see this, note that since Vi y^ V2, 
there must be some u* G Vi such that u* y v. Since y is modular, we have that either 
u* y V* or V* y V. Since, by choice of v*, we do not have u* y v*, we must have v* y v. It 
follows that Vs y V2.M 

Lemma 2.8: If t> is a modular strict partial order and satisfies the union property, then 

> 'IS qualitative. 

Proof: Suppose that > is modular strict partial order that satisfies the union property. 
To see that > is qualitative, suppose that (Fi U V2) \> V3 and (V'l U V3) > V2. Since > is 
modular, it follows that either (Vi [JV2) t>ViorVi > Vs. If {Vi [JV2) > Fi, then, using the 
fact that t> satisfies the union property and (Vi UV2) > F3, we get that (Vi U V2) > (Vi U V3). 
Using transitivity, it follows that (T'l U V2) \> V2. Using the union property again, we get 
that (Vi U V2) l> (Vi U V2)- This contradicts the assumption that [> is irreflexive. Thus, we 
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must have that Vi t> F3. A similar argument shows that Vi > V2. Using the union property, 
we get that Vi > (V2 U V3), as desired. I 

Lemma 2.9: // y is a total preorder, then and y' agree. In general, U y^ V implies 
U y' V, but the converse does not hold. 

Proof: It is immediate from the definitions that U y^ V imphes U y' V, and the fact that 
the converse does not hold is shown by Example 2.1. To show that y^ and y' are equivalent 
if ^ is a total preorder, suppose U y' V. Clearly U is nonempty, since F X* for all V. 
We want to show that U F, so we must show that for all i; G V, there is some u G U 
that dominates V such that u y v. We actually show that there is some u ^ U such that 
u y v' for all v' G V. Suppose not. Then for every u & U, there is some Vu such that we do 
not have u y Since ^ is a total order, this means that y u. But this, in turn, means 
that V y^ U, contradicting our assumption that U y^ V. Since there is a ii G U such that 
u y V ior all v ^ V, it easily follows that u* dominates V and that U V", as desired. I 

Theorem 2.10: Let J- be a finite algebra of subsets of W (that is, J- is a set of subsets 
ofW that is closed under union and complementation and contains W itself) and let > be 
an orderly qualitative relation on J-. 

(a) If t> is a total preorder on T , then there is a total preorder y onW such that > and 
y" agree on JF (that is, for U,V ^ T, we have U t> V iffUy^V). 

(b) If > IS a strict partial order and each nonempty set m !F has at least 2'°g(l-^l)'°^^''^'^ 
elements, then there is a partial preorder y on W such that t> and y^ agree on T . 

Proof: Part (a) was already proved in the main text, so we prove part (b) here. 

We proceed as follows. We say that a pair (yl, X) is minimal pair of \> \l X \> A and 
there is no X' C X ("c" is used here to denote strict subset) such that X' |> A. The 
minimal pairs in an ordered relation determine it. Indeed, the following stronger result 
holds. 

Lemma A.l: // > and >' are two orderly qualitative relations on T such that for each 
minimal pair (A^X) of t> we have X t> A, and for each minimal pair {A',X') of >' we 
have X' >' A' , then > = >'. 

Proof: Suppose the assumptions of the lemma holds and that X t> Y; we must show that 
X >' Y . Suppose A is an atom such that A (ZY . Since l> is orderly, we must have X |> A. 
Let X' be a minimal subset of X such that X' [> A. Since T is finite, such an X' must 
exist. Thus, {A.X') is a minimal pair of >. By assumption, we have X' >' A. Since >' 
is orderly, we also have X >' A. Thus, we have X ^' A for each atom A C Y . Since 
>' is qualitative, it also satisfies the union property, and hence X >' Y as desired. By 
symmetry, it follows that > = I 

A minimal-pair tree for > is a rooted tree whose nodes are labeled by atoms such that 
the following conditions are satisfied: 
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1. If a node in the tree labeled B is an immediate successor of a node labeled A, then 
there must be a minimal pair {A,X) of > such that B C X. 

2. If there is a node t in the tree labeled A and a minimal pair of > of the form (^4, X), 
then there must be some atom B C X such that a node labeled B is an immediate 
successor of t. 

3. There does not exist a path in the tree such that two nodes in the path have the same 
label. 

4. A node does not have two distinct successors with the same label. 

A minimal-pair tree is rooted at A if the root of the tree is labeled by the atom A. 

Since a subset of J- can be written in a unique way as the union of atoms, there is 
a 1-1 correspondence between subsets of T and sets of atoms. Thus, there are exactly 
log(|jF|) atoms. Because of the third condition, a path in the tree can have length at 
most log(|,F|). Since all the atoms on the path must be distinct, it follows that there 
are at most log(|J^|)! < log(|J^|)^°s(l-^l)(= |jr|i°gMI-5^l)) possible paths in a tree rooted at 
A. We can identify a tree with the set of its paths, which means that there are at most 
2iog(|j^|)! < 2i°g(l-^l)'°*"^" possible trees rooted at an atom A. 

We now label each element in W with a minimal-pair tree in such a way that every 
element of atom A is labeled by a tree rooted at A, and every minimal-pair tree rooted at A 
is the label of some element of A. Since we have assumed that A has at least 2'°s(l-^l)'°*"'^" 
elements, there is such a labeling. Let L{iv) be the label of node w. We define >- on so 
that w' >- w iS L{w') is a proper subtree of L{iu). Clearly >- is a strict partial order. 

We claim that [> agrees with By Lemma A.l, it suffices to show that if {A, X) is a 
minimal pair of >, then X A, and if {A,X) is a minimal pair of then X [> A. So 
suppose (A^X) is a minimal pair of >. We want to show that X A. Let iv G A, and 
suppose that L{w) = T. Thus, T is a minimal-pair tree rooted at A. The construction of 
minimal-pair trees guarantees that there is a successor of the root in tree T labeled B for 
some atom B C X. Consider the subtree of T rooted at B. This is a minimal-pair tree 
rooted at B, and hence must be the label of some w' ^ B C X. Thus, w' y w. It follows 
that X A. 

Now suppose that {A,X) is a minimal pair of We want to show that X [> A. 
Suppose not. As we show below, this means that there exists a minimal-pair tree T rooted 
at A such that no node in T is labeled by an atom contained in X. Let w be an element of 
A with L{tLj) = T. By construction, there is no element w' of X such that w' >- w. Thus, 
we do not have X A, contradicting our initial assumption. 

It remains to show that there exists a minimal-pair tree T rooted at A such that no 
node in T is labeled by an atom contained in X. Clearly, we cannot have X' t> A for some 
X' C X, for then, by the preceding argument, we would have X' A, and (-4, X) would 
not be a minimal pair of It follows that if {A, Y) is a minimal pair of >, then we must 
have Y -X ^D. 

Two general fact about orderly, qualitative relations will be useful in our construction: 
Lemma A. 2: // >' is a qualitative relation on J- and Y >' X, then {Y — X) >' X . 
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Proof: Notice that {Y-X)uX >' X. Since >' is qualitative, it follows that (Y-X) >' X 
(take both V2 and V3 in the definition of qualitative to be X). 

Lemma A. 3: // >' is an orderly, qualitative relation such that {Xi U X2) >' X^ and 
X' t>' X-i. then (Xi UX') >' X3. 

Proof: Since >' is orderly, our assumptions imply that {Xi U X' U X2) >' X3 and that 
{Xi U X' U X3) [>' X2. Since [>' is qualitative, it follows that (Xi U X') > (X2 U X3). The 
result follows using the fact that >' is orderly again. I 

We start by constructing a tree whose nodes are labeled by atoms and whose root is 
labeled by A. We proceed in log(|^|) + 1 stages. At each stage, we have a tree whose nodes 
are labeled by atoms. At stage 0, we just take a single node labeled by A. Suppose we 
have constructed a tree whose nodes are labeled by atoms and whose root is labeled by A 
at stage k < log(|JF|). For stage A; + 1, for each leaf t in the stage-A; tree, if t is labeled by 
B, then for each atom C, if there is a minimal pair {B,Y) of > with C C y, we add a 
successor to t labeled C. We call the tree constructed at the end of stage log(|.?^|) the full 
tree for A. 

We next mark nodes in the full tree in stages. At the kth stage, for each atom 5, we 
mark an unmarked node t labeled B if one of the following three conditions holds: (1) 
B C X, (2) there is an ancestor of t in the tree also labeled (3) there is a minimal pair 
(B, Y) of t> and all the successors oft with a label contained in Y were marked at an earlier 
stage. If there are no unmarked nodes satisfying one of these three conditions at stage A;, 
then the marking process stops. Otherwise, we continue to stage A; + l. Since there are only 
finitely many nodes, this marking process is guaranteed to terminate. 

Our goal is to show that, at the end of the marking process, the root of the full tree 
is unmarked. For if this is the case, let T be the subtree of the full tree consisting of all 
the unmarked nodes all of whose ancestors are unmarked. It is easy to check that T is a 
minimal-pair tree and our marking procedure guarantees that no node in T is labeled by 
an atom contained in X, so we are done. 

To see that the root of the full tree is unmarked, we proceed as follows: Define a 0-cover 
for a node t in the full tree to be just t itself Suppose we have defined a A;-cover for t. A 
set Z of nodes is a (A; + l)-cover for t if there exists a A;-cover Z' for t such that for some 
node t' in Z' labeled B and some minimal pair (B,Y) of >, we have that Z consists of all 
the nodes in Z' except for t', together with all the successors of t' that are labeled by an 
atom contained in Y. An easy argument by induction on k shows the following. 

Lemma A. 4: If Z is a k- cover for a node t labeled C and k > 0, then there exist a set Y 
such that (C, y) is a minimal pair of t>, successors ti,...,tm oft in the full tree, atoms 
Di, . . . , Dm such that Y = U^iDi and Di is the label of ti, i = 1, . . . ,m, and a partition 
Zi, . . . , Zm of Z into disjoint subsets such that Zi is a ki- cover for ti, i = l,...,m, for 
some ki < k. 

Given a set Z, let U"^ consist of the union of the atoms labeling the nodes of Z still 
unmarked at the nth stage (we take to be the union of the atoms labeling the nodes in 
Z); given a node let Vt consist of the union of the atoms D labeling ancestors of t such 
that t or some descendent of t has the label D. 

The key fact is the following result. 
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Lemma A. 5: If Z is a k-cover for a node t labeled C and k > 0, then {U"^ UVtU X) t> C. 

Proof: We proceed by induction on k, with a subinduction on n. If A; = 1, then there is 
some set Y such that (C, Y) is a minimal pair of > and the nodes in Z are labeled by the 
atoms contained in Y. Since (C,Y) is a minimal pair of >, we have that Y t> C. Since > 
is orderly, (Y U Vt U X) \> C. By definition, = Y, so this takes care of the case n = 0. 
Suppose n > and {U^~^ UVtUX) > C. For the inductive step, it suflfices to show that 
that if 

(Y' UVtUX) > C (1) 
and D is the label of a node t' in Z marked at stage n, then 

{{Y' - D)UVtUX) t>C. (2) 

So suppose that (1) holds and D is the label of t'. We must consider how t' was marked. 
If D C X then (2) is immediate. If there is an ancestor of t' also labeled D, then D C Vf, 
and, since A; = 1, we have Vti CVtUC. Thus, since > is orderly, it follows that 

((y' - D)UVtUXuC) > C, (3) 

so (2) follows from Lemma A. 2. Finally, suppose there is some minimal pair {D,Y") of 
> such that all the successors of t' labeled by an atom in Y" are marked by stage n — 1. 
Let Z' consist of the successors of t' labeled by atoms contained in Y". Z' is a 1-cover for 
t' . Since U^7^ = 0, it follows from the induction hypothesis that (Ff U X) t> D. Again, 
since Vf C Vf U C, (3) follows orderliness and Lemma A. 3, and the desired (2) follows from 
Lemma A. 2. 

Now suppose k > 1. Let Y,Di,..., Dm, Zi, . . . , Z^, ii, ■ ■ ■ ,tm be the sets and nodes 
guaranteed to exist by Lemma A. 4. Since Zi is a fcj-cover for ti for some ki < k, by 
the induction hypothesis, (?7|. U Ft, U X) |> A- Since U^^ C and Vt, C VtUC, by 
orderhness, we have that (11^ U Vi U X U C) t> Di. Since > is qualitative, we have that 
{U§ U U X U C) t> (UiDi). Since U^A = ^ and Y [> C, (3) now follows, and again (2) 
follows from Lemma A. 2. I 

Finally, suppose, by way of contradiction, that the root r of the full tree is marked, say 
at stage n of the marking process. Lemma A. 2 assures us that A n X = since (A^X) 
is a minimal pair of x", so condition (1) of the marking process does not apply. Since r 
has no ancestors, condition (2) does not apply either. Thus, there must be some minimal 
pair {A, Y) of > such that all the nodes in the set Z consisting of the successors of r in 
the full tree that are labeled by atoms contained in Y are marked by stage n — 1. Thus, we 
?7|-i = 0. Since 1/^ = and Z is a 1-cover for r, by Lemma A. 5, it follows that X t> A, 
contradicting our original assumption. | 

For the completeness theorems (Theorems 3.1 and 3.2) it is convenient to start by prov- 
ing Theorem 3.2, since it is simpler, and contains the key ideas for the proof of Theorem 3.1. 

Theorem 3.2: AX^ is a sound and complete axiomatization of the language C with 
respect to totally preordered preferential structures. 
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Proof: Soundness was proved in the main text, so we just consider completeness here. 
Suppose that is consistent with AX^. We want to show that that is satisfiable in a 
totally preordered preferential structure. Let (fi, . . . ,(pm be the basic likelihood formulas 
that are subformulas of ip. By definition, is a Boolean combination of these formulas. 
Define an atom over ip to he a conjunction of the form tpi A ... A 'ipm, where tlJi is either or 
Using straightforward prepositional reasoning (LI and MP), it is straightforward to 
show that ip is provably equivalent to the disjunction of the consistent atoms over ip. Thus, 
since ip is consistent, some atom over ip, say cr, is consistent. We now construct a totally 
ordered preferential structure satisfying a. Clearly this structure will satisfy ip as well. 

Let pi,...,p„ be the primitive propositions in $ that appear in ip. Let S consist of 
all the N = 2" truth assignments to these primitive propositions. We take W = E and 
let JF consist of all subsets of E. We define a total preorder [> on ^ as follows. Notice 
that to each set V in there corresponds a propositional formula ipv that is made true 
precisely by the truth assignments in the subset V of E that corresponds to V. To be 
precise, given a truth assignment a, let ip^ consist of the conjunction gi A . . . A where qi 
is Pi if a{pi) = true, and -^pi otherwise. Let ipv be the disjunction of the formulas pa for 
a G v. (We take the empty disjunction to be the formula /a/5 e.) Notice for future reference 
that PV-1UV2 is provably equivalent to pvi ^^¥2- Conversely, for every propositional formula 
ijj that mentions only the primitive propositions in {pi,...,p„}, there is a corresponding 
subset in JF that consists of all truth assignments that make ip true. 

We define a binary relation [> on JF as follows: V > V iff AX h cr ^ {ipv S> ipv')- 
We claim that > is a modular, qualitative, strict partial order on T. The fact that > is 
irreflexive follows easily from L2; the fact that it is orderly follows from L4; the fact that 
it is qualitative follows from L3; transitivity follows from the fact that > is qualitative and 
orderly, by Lemma 2.4; modularity follows from L5. All these arguments are straightfor- 
ward. We prove the fact that > is qualitative here, and leave the remaining arguments to 
the reader. 

Suppose Fi,V2,F3 G JF, (Vi U V2) \> V3, and (Vi U V3) > V2. Our assumptions and 
the definition of F imply that AX h cr ^ (iWi V pv^) ^ W3) and that AX h cr ^ 
{{pvi V pvs) ^ ^¥2)- By L3 and straightforward propositional reasoning, we get that 
AX h cr ^ ((pvj ^ {ipY^ V (pvj)), SO that Vi > (V2 U V3), as desired. 

By Lemma 2.6, there is a total preorder >' on .F such that > is the strict partial order 

determined by By Theorem 2.10(a). there is total preorder ^ on W such that >' and 
agree on JF. Since >-' is the strict partial order determined by it follows that y' and 
> agree. Since ^ is a total preorder, by Lemma 2.9, and > agree. Let M = {W, ^,7r). 
We now claim that for each formula pj that is one of the basic likelihood formulas that is a 
subformula of p, we M \= ipi iff pj is a conjunct of cr. For suppose p)j is of the form ^ -0'. 
If Pj is a conjunct of cr, then clearly AX h cr ^ (?/; ^ ■;/;'). Thus, A^ > .4,,y by definition, 
so A^ A^i by construction. Since A^ and A^i consist of the worlds in W where ijj and 
tp' , respectively, are true, it follows that {M,w) \= ip ^ ip'. On the other hand, if -tipj is a 
conjunct of cr, then we have AX h cr ^ -i(i/; S> ip'). We must have (M,w) \= -^{ip » ?/»'), 
for if (Mjw) \= ip ^ V^', the same arguments as those above would imply that A^ > yl^/, 
and so AX \- a ^ ip ^ Tp', contradicting the consistency of cr. 

Thus, M satisfies cr, and hence p. I 
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Theorem 3.1: AX is a sound and complete axiomatization of the language L with respect 
to preferential structures. 

Proof: Again, soundness is proved in the main text, so we just consider completeness. The 
ideas are much in the spirit of the proof of Theorem 3.2. We again take S to consist of all 
the N = 2^ truth assignments to these primitive propositions. However, since we plan to 
apply part (b) of Theorem 2.10, we no longer take = S. Rather, we take W to consist 
of 2"" copies of the truth assignments in E. More precisely, let W consist of the N2^" 
worlds of the form w^^, such that i = 1, . . . , 2"" and a G S. Let T consist of all subsets of 
W that correspond to subsets of S; that \s,V^lF iff there exists some V C S such that 
V = {w]^ : 1 = 1,..., 2"", a G V'}. Clearly, T is & finite algebra with N elements, and 
each nonempty set in !F has at least 2'°s(l-^l)'°^^'^'^ elements. 

We define a strict partial order > on JF just as in the proof of Theorem 3.1: F > F' iff 
AX h (7 ^ ipv ^ ^v' ■ As before, > is an orderly qualitative strict partial order on T. It 
is not necessarily modular, since we no longer have L5. 

By Theorem 2.10(b), there is a partial preorder y onW such that |> and agree on 
J^. Let M = {W, ^, vr), where 7r(i(;^) = a. Just as in the proof of Theorem 3.2, we can now 
show that M \= a. |. 

As we noted earlier, Daniel Lelimann has found another proof for Theorem 3.1, using 
results from (Kraus et al., 1990). To show that a formula in C that is consistent with AX 
is satisfiable, he first translates it to a formula of conditional logic (using Proposition 4.3). 
It then follows from the representation theorem of (Kraus et al., 1990) that this translated 
formula is satisfiable in a preferential structure. The original formula is then satisfiable in 
the same structure. This proof allows us to avoid using Theorem 2.10 altogether. However, 
we feel that Theorem 2.10 gives insight into the connection between partial orders on worlds 
and partial orders on sets of worlds, and thus is of interest in its own right. 

Proposition 3.4: // a formula is satisfiable m a totally preordered preferential structure, 
then it is satisfiable in a totally preordered preferential structure with at most one world per 
truth assignment. 

Proof: This follows immediately from the completeness proof of Theorem 3.2; the structure 
constructed in that proof has one world per truth assignment. | 

Lemma 4.1: // W is finite, then bestd-^Jjvf) C |i^]m iff for all u G {-'(p A iP}m, there 
exists a world v & {(f A tPIm such that v y u and v dominates {-^(f A ^]m- 

Proof: Suppose bestd-^jM) ^ |(y3]M- If w G A ^Jm, then we cannot have u G 
best(|(/(.']M)5 since bestd-^jM) C |!yp]M- Since W is finite, there exists a world v G bestd-^Jjvf ) 
such that V >- u. Since v G bestd-^jM), we have that v dominates f-^ip A -^Jm- Conversely, 
suppose that for all u G {-^(f A ^Jm, there exists a world v G [y? A such that v y u 
and V dominates {-'ip A 'ilflM- H u E bestdi/;]M)- then we must have u G |<p]m5 for if not, 
there exists a world v E ftp A tPJm such that v y u, contradicting the assumption that 
u G bestd^lM). I 
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Lemma 4.2: For all structures M, we have M \= ip ^ tp iff M \= ip (p. 

Proof: Suppose M \= ip ^ ip. By definition, this means that for all u G A there 
exists a world v G A -^Jm such that v y u and v dominates {-^(f A ^]m- It immediately 
follows that (a) if {(p A ipjM = then A ipjM = and (b) if {(p A ipjM 0: then by 
definition we have M \= ip A tJj ^ -^(p A tt. It follows from (a) that if ftp A -^Jm = then 
I^Jjv^ = 0, so M 1= K^i\ and from (b) that if {p A -(/'Im then M |= (/? A ^ » -.(p A ^. 
Thus, M \= K^tp V A > A -^); i.e., M |= 

The converse follows equally easily. Suppose M \= ip (p. Clearly if M |= K^ip then 
we trivially have that for all u G A "^Jm, there exists a world v ^ {ip A i^Jm such that 
V >- u and v dominates {-^p A ?/'']m- On the other hand, if M \= p A iIj » -^p A ip, then it 
follows by definition that for all u G {-'(p A i>}M, there exists a world v ^ {ip A iJj}m such 
that V y u and v dominates f-^p A ^]m- Either way we have M \= ip ^ p. | 
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